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Philosophy, Ground Rules, and Assumptions 


Why did NASA/MSFC/EV44 (EV44) take on this project? 

• General support for RCC programs and products. 

• Use in Earth Global Reference Atmospheric Model (Earth-GRAM). 

Data quality is stressed over quantity. 

• If a profile fails a quality control (QC) check for one parameter then 
that profile is removed from computations for all parameters. 

• Some QC relies on subject matter expertise (SME). Subjective 
judgments emphasize conservatism. "If in doubt, throw it out." 

Process is performed in discrete steps. 

• Output results from each step are saved in separate data files. This 
allows intermediate process inspection. Outputs from one step are 
used as the inputs to the next step. 

• A lofty goal is full automation, but the difficulties associated with 
"real data" require SME interaction and babysitting. 



Possible Methodology Outlines 
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1: Add up lists 
of numbers, 
divide by 
how many 
there are 


C 


BEGIN 


> 


1: List sites of interest 


2: Define parameters 
■ 


3: Gather the data 


4: Format/Subset the data 


5: QC the data 
6: Interpolate data 
7: Compute statistics 


8: Diagnostic testing 


9: Validation testing 


10: Post-processing 


C 


END 


> 



Identify and 
remove bad 
profiles 



1: Pour coffee 

2: Sit in office chair 

3: Boot computer 



• • • 



N: Pour more coffee 



• • • 



M-l: Save document 

M: Yell "WO 

OT! !" 



Level of Detail 
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Step 1: Determine Sites of Interest 

Phase 1: Funded by NASA Space Launch System program. 
Phase 2: Funded by Range Commanders Council. 


Wake Island 


X 



\ 





Thule AB 

Dugway Proving Grounds 




China Lake NAWS 



Vandenberg AFB 



Point Mugu NAS/NBVC 




Edwards AFB 


\ 



Barking Sands PMRF 


Kwajalein/Reagan Test Range 
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Step 2: Define Parameters 




Vertical coordinate 


Geometrical altitude in meters above Mean Sea Level 


Physical variables 

Wind speed: 

Zonal wind: 

Meridional wind: 
Temperature: 

Dewpoint: 


Virtual temperature: Tv 
Pressure: P 

Density: D 

Vapor pressure: VP 


Statistical quantities 


Mean value: 
Median value: 
Standard deviation: 


M- 

MDN 


Skewness coefficient: SKEW 
Linear correlation: r 




Step 3: Gather the Data 
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First preference: Get data directly from range weather office. 

Cape Canaveral Vandenberg 

Edwards Wallops 

Wake Island China Lake 


Second preference: Get data from archival/distribution site. 


National Climatic Data Center (NCDC), 
Integrated Global Radiosonde Archive (IGRA) 




Kwajalein 

Dugway 

Eglin 

Kodiak 

Wallops 

Vandenberg 


Wake Island 
Barking Sands 
Thule 
Yuma 
China Lake 
Point Mugu 


Earth System Research 
Laboratory (ESRL) 

Yuma Point Mugu 

China Lake 





< 

v. 


1992 

1992 

1992 

1992 

1992 

1992 

1992 

1992 

1992 

1992 

1992 

1992 

1992 

1992 

1992 

1992 

1992 

1992 

1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 
1993 


Step 4: Format/Subset the Data 
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51 | 2.0 1009.000 23.35 21. 55 

43 | 2.0 1009.000 26.65 22.75 


-6.00 -1.60 | 

-3.50 -0.60 | 


51.2 1000.000 27. B5 21.36 -6.30 

72.2 1000.000 26.05 22.66 -4.40 


464.2 957.000 23.25 22.14 

752.0 925.000 20.35 18.34 


XaX 

-9.20 


XaX | 

-1.60 | 


619.6 940.000 21.85 21.15 XaX 

1139.1 B35.000 17.85 16.75 XaX 


XaX I 
XaX I 


;.3 1303.003 23.45 23.46 


4i5.i sgi.ooo 


59rf 942.000 


NASA/MSFC/EV44 has a standard format for archiving data. 


"m i........ rm rrr? mr. tti 31 .* i.l. . lll 7 m 77— r~ 

36 | 2.0 1003.000 26.65 21.66 -4.00 -4.70 | 72.2 1000.000 26.25 21.56 


01 IB 00 


29 | 
35 | 
46 | 


01 19 00 54 | 


01 20 00 43 | 


mr. -s.dL i rrrt — i-ii.... 7m tttt" 

-4.10 -5.90 | 751.0 925.000 19.45 IB. 75 


ES i TTT — mm 7m TTJ -fc.fc. I 

-8.90 I 763.1 924.000 19.45 IB. 75 XaX XaX | 


Master File Format (MFF) 

Various input formats (Shuttle, IGRA, ESRL) are converted to MFF. 

Remove 'garbled' and duplicate profiles identified during data ingest. 

Convert year values from 2-digit to 4-digit, if necessary. 

Convert various "missing data" flags (ex. -999.99) to IEEE NaNs. 

Compute U and V winds from wind speed and direction. 

Input datasets with long periods of record (POR) are trimmed to 
highlight most recent data (highest quality, most representative). 
Standard POR is from 1990 to present. If sample sizes are insufficient, 
then older data are included. 


Multiple-source input data are integrated into a single file. 


o 


2.0 1012.000 

2.0 1012.000 

2.0 1011.000 

2.0 1011.000 

2.0 1010.000 

2.0 1010.000 

2.0 1011.000 

2.0 1011.000 

2.0 1011.000 


26.65 

23.25 

26.35 

23.35 

28.35 

27.25 

23.35 
27.05 
29.45 


21.66 

21.25 

22.46 


;.B6 


23.96 

23.95 

23.96 
23.06 
23.46 


-7.10 

-7.50 

-6.70 

-8.50 

-7.50 

-6.70 

-6.30 

-4.80 

-3.80 


-4.10 | 
-6.30 | 
-3.90 | 
-4.90 | 
-6.30 | 
-3.90 | 
-5.30 | 
-2.90 | 
-3.30 | 


106.3 1000.000 
230.6 936.000 

93.3 1000.000 
93.3 1000.000 

90.2 1000.000 

89.2 1000.000 

93.3 1000.000 

83.3 1000.000 

93.3 1000.000 


25.35 
23. B5 

26.25 

27.25 
27.45 

26.25 
27.65 

26.25 

27.25 


21.56 

19.95 
23.06 
23.36 

23.96 
23.95 
23.55 
23.35 
23.35 


-9.30 

XaX 

- 10.20 

- 10.20 

-9.70 

-3.10 

-3.40 

- 6.20 

-5.10 


-4.40 | 
XaX | 

-5.90 | 
-5.90 | 
-6.30 | 
-4.70 | 
-5.90 I 
-3.60 | 


I 


733.1 
634.7 

773.1 

239.6 

272.7 

250.7 

247.6 

613.6 

217.6 


925.000 

941.000 

925.000 

934.000 
9BO.OOO 
9B2.000 
9B3.000 

942.000 

937.000 


20.45 
19. B5 

20.05 

25.05 
24.35 

24.65 

25.65 

21.45 
24.35 


19.05 
IB. 75 
19.34 
23.55 
23.96 
24.14 
22.75 
21.25 

24.05 


-14.70 

XaX 

-15.90 

XaX 

XaX 

XaX 

XaX 

XaX 

XaX 


-2.60 | 

XaX | 
-4.30 | 

XaX | 
XaX | 
XaX | 
XaX | 
XaX | 
XaX | 


879.4 

763.0 
150B.2 

776.1 

774.1 

770.1 

491.3 

776.1 

495.3 


816.000 

927.000 
B 50. 000 

925.000 
925.000 

925.000 

956.000 

925.000 

856.000 


20.05 

19.45 

16.45 

20.65 

21.25 

21.65 

24.25 

20.65 


IB. 75 
16.36 
15.45 

19.35 
20.75 
20.56 

20.36 
20.06 


XaX 


-16.90 

-16.30 

XaX 

-15.00 

XaX 

- 12.20 


L65 


L15 


XaX 


XaX | 
XaX | 

-1.50 | 
-7. B0 | 

XaX I 

-5.50 | 

XaX | 
-2.20 I 

XaX I 


759.0 

1432.1 

755.0 

761.0 

640.7 

1496.2 

771.1 

373.4 
BBS. 4 

759.0 

1124.1 

976.7 

777.1 
B57.3 

1400.9 

1277.5 

768.1 

759.0 

775.1 

1095.0 
312B.6 

B34.2 

1504.2 

1514.2 

731.1 

1511.2 

330.4 

795.1 

1520.3 

352.3 

1269.5 

1031.3 

1068.9 

1223.4 

3150.6 

1520.3 

313.2 

907.5 

1325.7 

1529.3 

2633.8 
B05.2 

1432.1 

797.1 

1516.2 

794.1 

796.1 

872.4 

1377.3 

1516.2 

1020.3 

1264.5 

1534.3 
B6B.3 

1547.3 

1061.9 
1119.1 

990.7 

622.7 


925.000 

350.000 

925.000 

925.000 

939.000 

350.000 

925.000 

914.000 

911.000 

925.000 

837.000 

904.000 

925.000 

916.000 

360.000 

372.000 

925.000 

925.000 

924.000 
B90.000 

700.000 

919.000 

350.000 

350.000 

925.000 

350.000 

916.000 

925.000 

350.000 

919.000 

375.000 

900.000 

396.000 

330.000 

700.000 

350.000 

923.000 

914.000 

369.000 

350.000 

745.000 

923.000 

852.000 

925.000 

350.000 

925.000 

925.000 

917.000 

364.000 

350.000 

901.000 

374.000 

343.000 

916.000 

346.000 

395.000 

339.000 

903.000 

942.000 


20.6! 
15. B! 
21.6! 
21.4! 


17.6! 

21.4! 

19.3! 

13.4! 

19.3! 

13.0! 

19.0! 

20.0! 

19.6! 

16.2! 

16.0! 


19.4! 

19.6! 

17.0! 


IB. 6! 
16. 3! 
17.8! 
20.6! 
17.2 
19.6! 
21.0! 
16.2! 


16.4! 

1B.0! 

17.2! 


18.3! 

19.0! 

17.0! 

15.6! 

11 . 0 ! 

20.2! 

15.6! 

19.8! 

17.4! 

20.0! 

20.4! 


16.0! 

15.0! 

19.0! 

15.4! 

16.4! 


17.0! 

19.0! 

18.! 

13.3! 

21.! 



Step 5: Quality Control the Data 
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Out of bounds value check. Convert the following to NaNs: 


U or V values > 200 m/s. 

T values < -100 C 
T values > 70 C. 

Td values where T < -60 C. 


Td value < -60 C. 

P value < 0 mb 
P value > 1200 mb. 
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Remove profiles for the following conditions: 


Lowest reporting altitude has no valid data (NaNs). 

# levels with any valid data < 10. 

# levels with valid P, T, Td, U, or V data < 8. 

Lowest reporting altitude > nominal surface + 0.1 km. 

Minimum height between adjacent valid data altitudes > 5 km. 
Maximum wind shear between adjacent levels > 0.3 s' 1 . 

Profile is judged to be erroneous by visual inspection by SME. This is 
an explicitly interactive process. 





Step 6: Interpolate the Data 



ESSSA Group 



6.1: Establish output altitude grid. 

6.2: Compute geopotential heights for output grid. 

6.3: Interpolate wind values to output grid. 

6.4: Interpolate pressure to output grid. 

6.5: Interpolate temperature, dewpoint to output grid 

6.6: Compute derived quantities. 


7 


7 


i — V 


t 
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Step 6.1: Establish Output Altitude Grid 




Step 6.2: Compute Geopotentials 
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Compute latitude-dependent surface gravity. 


g ^ = 9.780356 x (1 + 5 . 2885 E 3 x sin 2 <p - 5 . 9 E 6 x sin 2 20 ) 



\ \ \ \ ~V 


Compute vertical derivative of gravity. 


= - 3 . 085462 E ~ 6 + 2 . 27 E ~ 9 X cos 2 cp - 2 E ~ 12 x cosAcf) 


Z = 0 


£ 


Compute effective Earth radius. 


Reff — 


2 g<p 


'dg\ 

dZj z = o 


± 


± 




Compute geopotential heights. 



H 7 = 


do 


x R 


EFF 


X 


R 


EFF 


+ z 


X 


Resulting output grid geopotential heights are named H 


our 
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Step 6.3: Interpolate Wind Values 



Compute geopotential heights for input grid wind data. 


Same procedure as in 6.2. These values are named H jn . 


For each N th output geopotential grid value, H out N , find nearest bounding 
upper and lower input grid geopotential values. 



H a = minimum of H in values where H in > H out N . 
H b = maximum of H in values where H jn < H out N . 


Find input grid indices for bounding geopotential heights and note 
bounding wind values. 


Interpolate Wind values. 



WS 
U 


N 


T 


v 


WS B + (WS A - WS B ) * c x 
Ub + JUa-Ub)*^ 

v B + (V A - V B ) * q 


"N 


Where C 1 = 


_ (^out,JV h b ) 


(h a ~ h b ) 


J 


\ 




l A , l B such that: 

Hin Oa) = H A . 

H in Ob) = h b- Then . 


WS A = WS(I A ), 

U A = U(I A ), 

>< 

II 


WS B = WS(I B ), 

U B = U(I B ), 

CO 

> 

II 

CO 

> 


L l l 1 1 1 \ \ \ \ 


Step 6.4: Interpolate Pressure 
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Compute H a , H b , I a , and l B . 


z 


Same procedure as in 6.3. 


/ 


/ 


Compute nearest lower bounding pressure. 


Pb = P0b>- 


Compute interval average virtual temperature. 


z 


/ 



Procedure for computing Tv shown on following slides. 
Tv ave = [Tv(I a ) + TV(I b )]/2. 





_ 


Interpolate pressure values. 


P N = P R x EXP 


B 


( 


H b -H a 


29.2712617 X Tv AVE 


)• 


1 — / 
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Step 6.5: Interpolate Temperature, Dewpoint 
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Step 6.6: Compute Derived Quantities 


Compute vapor pressure. 


[■ 


17.67 xTd 


VP = 6.112 X 10L(7’d+243.5)J < 


Compute virtual temperature. 





VP 
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First, define water vapor mixing ratio: w = e x p _ yp . Then, 
T v = T x (1+w/e) x (1 + w) 1 


Compute density. 



D = 348.36787 X P X Tv 1 . 


/ 




V 


T 


Step 7: Compute Statistical Values 
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Computations are made independently for each altitude. 
Monthly, net annual values. 

• Sample size: 

Wind, Thermo, Humidity. 

• Mean values: 

U, V, WS, P, T, D, VP, Tv, Td. 

• Median values: 

U, V, WS, P, T, D, VP, Tv, Td. 

• Standard deviations: 

U, V, WS, P, T, D, VP, Tv, Td. 

• Skewness coefficients: 

WS, P, T, D, VP, Tv, Td. 

• Correlation coefficients: 

L), V. fX ^ 
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Compute Mean and Median Values 


Mean values: 

Hx = w -1 x 


Median values: 


Let X = sort(X ). Then, MDN X = < 

r X odd N. 

j X [^(f) + ^(i +1 )] evenN - 
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Compute Standard Deviation and Skewness 


Variance: 

VAR x = ^ x 2f=i ( *;-fe) 2 - 


Standard deviations: 

o x = VVAR X . 


Skewness: 


SKEW, = i X £f =1 
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Compute Wind Component Correlation 


Linear Pearson correlation coefficient: 


ZiLiWi-HuXVi-Hv)] 

U,V XfL^Vi-av) 2 



Step 8: Diagnostic Testing 
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Tests performed independently for U, V, WS, T, Td, and P. 



• Computed RRA mean values and standard deviations 
are used to produce |u ± 6a envelopes for each month. 

• All constituent profiles are compared to the envelopes. 

• If all profiles are within the envelopes, then diagnostic 
testing is complete and process continues on to 
validation testing. 

• Any profile with any value outside the respective 
envelopes are removed from the set of interpolated 
profiles. Once this is complete, then step 7 is repeated 
with the new set of input profiles. 

• This cycle is iterated until there are no envelope 
exceedances. 
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Diagnostic Testing Results (Example) 




Step 9: Validation Testing 
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A total of ten validation tests are performed 


• Five skewness tests: P, T, Td, D, WS. 

• Three Buell relationship tests. 

• Gas law reconstruction test. 

• Wind component reconstruction test. 





Validation Testing: Skewness 
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Monthly skewness values at each altitude are compared to 
established limits. Any noted exceedances are flagged as 
failures. 


Parameter 

Valid Skewness Condition 

ws 

SKEW < 4.0 for fiws < 15 m/s 

SKEW < 2.5 for flws > 15 m/s 

P 

-2.5 < SKEW < 2.5 

T 

-2.5 < SKEW <2.5 

D 

-3.5 < SKEW <3.5 

TD 

-2.5 < SKEW <2.5 




Validation Testing: Buell Relationships 


Equalities relating thermodynamic statistical parameters. 
Any month/altitude combinations where | LHS-RHS | >0.1 
are flagged as failures. 


#1 

#2 

#3 





Buell, C.E., Some 
relations among 
atmospheric 
statistics, J. Met., 
11, 1954 


Thermodynamic 
correlation terms 
are not part of 
RRA output but 
are computed 
concurrently for 
this test 
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Validation Testing: Gas Law Reconstruction 


Specific gas constant, R, is derived from output RRA mean 
values and compared to the accepted value. Any differences 
greater than 0.5 J kg 1 K 1 are flagged as failures. Note that 
this test is only applied above 10 km, where the air is 
assumed dry. 


R 


RRA " 


P 

DxT 


^accepted = 287.058 J kg 1 K 1 
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Validation Testing: Wind Reconstruction 


Assuming a bivariate normal distribution of the U and V wind 
components, the component statistics (mean and standard 
deviations) can be related to the wind speed statistics. A 
monthly mean wind speed estimate is computed from this 
relationship and compared to the RRA mean wind speed. 

Any differences greater than 3 m/s are flagged as failures. 


M-ws, 


estimate 


- V /% 2 + ~Pv 


+ (Ju 2 


+ o v 2 - 


o 


ws 






Validation Testing Results (examples) 


Buell Relationships 



- 0.10 - 0.05 0.00 0.05 0.10 

LHS-RHS (unitless) 
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Validation Testing Results (examples) 


Wind Speed Skewness 


WS Skew Test: Dec DUG 



-2 0 2 4 6 

Skew WS 



Validation Testing Results (examples) 


Gas Law Reconstruction 



290 
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Validation Testing Results (examples) 


Wind Speed Reconstruction 
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Validation Testing Notes 


• All tests are performed analytically. Graphs are only used 
for visualization. 

• A validation test "failure" does not identify the particular 
bad profile(s) causing the failure. If a failure is noted, then 
various idiomatic secondary analyses are performed to 
identify the profiles causing the failure condition. This 
process is highly interactive and relies heavily on SME 
experience and judgment. 

• After a dataset passes all validation tests, then an 
independent validation is performed by other EV44 
personnel using separately implemented methodology. 
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Step 8: Post-Processing/Documentation 


• Generate plots of all RRA statistical parameters. 

• Save RRA data to Excel spreadsheet format. 

• Save timestamp listing and inventory files for all profiles 
used for final RRA production. 

• Create Earth GRAM-formatted text files. 

• Produce RRA development reports for each site. 

• Send Excel files and development reports to the RCC-MG 
Meteorological Support Committee chair, for posting on 
the EAFB weather office web site. 




Summary 
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• New RRA datasets have been created for 15 sites. These 
are available on the EAFB weather office web site. 

• The New RRAs are also available, in Earth-GRAM format, 

by requesting Earth-GRAM 2010 V.4 from EV44. POC is 

Patrick White 

256 - 544-5776 


• Now that EV44 has developed the capability, we would 
like to support additional future developments. Providing 
this support operationally may require some finagling. 

Due to the nature of the process and the necessity of SME 
interaction, EV44 would prefer not to give out our 
software to avoid potential misapplication. 



Questions 
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Periods of Record Used 
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SITE Start POR End POR # Profiles Data Source 


Cape Canaveral 

11/26/1988 

12/31/2011 

16813 

Station 

Edwards 

1/2/1990 

4/4/2012 

9291 

Station 

Vandenberg 

12/2/1992 

1/7/2013 

9733 

Station + IGRA 

White Sands 

1/2/1992 

8/26/2012 

9055 

IGRA 

Wallops 

1/1/1990 

1/7/2013 

15108 

Station + IGRA 

China Lake 

1/8/1980 

12/18/1997 

3506 

IGRA + ESRL 

Point Mugu 

1/23/1971 

8/27/2013 

8386 

IGRA + ESRL 

Dugway 

1/1/1990 

11/17/2013 

15817 

IGRA 

Yuma 

10/19/1971 

12/24/2013 

8650 

IGRA + ESRL 

Eglin 

1/28/1980 

11/13/2013 

11909 

IGRA 

Kwajalein 

1/1/1990 

11/17/2013 

14772 

IGRA 

Kodiak 

1/1/1990 

11/17/2013 

16465 

IGRA 

Wake Island 

1/1/1980 

5/13/1997 

11839 

IGRA 

Barking Sands 

1/1/1980 

1/27/2015 

17037 

IGRA 

Thule 

1/1/1980 

10/10/2006 

13418 

IGRA 






